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Abstract. We develop an idempotent version of probabilistic potential the- 
ory. The goal is to describe the set of max-plus harmonic functions, which 
give the stationary solutions of deterministic optimal control problems with 
additive reward. The analogue of the Martin compactification is seen to be 
a generalisation of the compactification of metric spaces using (generalised) 
Busemann functions. We define an analogue of the minimal Martin boundary 
and show that it can be identified with the set of limits of "almost-geodcsics" , 
and also the set of (normalised) harmonic functions that arc extremal in the 
max-plus sense. Our main result is a max-plus analogue of the Martin represen- 
tation theorem, which represents harmonic functions by measures supported 
on the minimal Martin boundary. We illustrate it by computing the eigenvec- 
tors of a class of translation invariant Lax-Olcinik semigroups. In this case, we 
relate the extremal eigenvectors to the Busemann points of a normcd space. 



1. Introduction 

There exists a correspondence between classical and idempotent analysis, which 
was brought to light by Maslov and his collaborators |Mas87llMS^IKM97IILMS01| . 
This correspondence transforms the heat equation to an Hamilton- Jacobi equation, 
and Markov operators to dynamic programming operators. So, it is natural to 
consider the analogues in idempotent analysis of harmonic functions, which are the 
solutions of the following equation 

Ui — sup(Aij + Uj) for all i £ S. (1) 

The set S and the map A : S x S ^ RU {— oo}, (i, j) i-^ Aij , which plays the role of 
the Markov kernel, are given, and one looks for solutions m : S* — > RU{— oo}, i i— > Ui. 
This equation is the dynamic programming equation of a deterministic optimal 
control problem with infinite horizon. In this context, S is the set of states, the 
map A gives the weights or rewards obtained on passing from one state to another, 
and one is interested in finding infinite paths that maximise the sum of the rewards. 
Equation |^ is linear in the max-plus algebra, which is the set MU {—00} equipped 
with the operations of maximum and addition. The term idempotent analysis refers 
to the study of structures such as this, in which the first operation is idempotent. 
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In potential theory, one uses the Martin boundary to describe the set of harmonic 
and super-harmonic functions of a Markov process, and the final behaviour of its 
paths. Our goal here is to obtain analogous results for Equation 

The original setting for the Martin boundary was classical potential theory 
|Mar41j . where it was used to describe the set of positive solutions of Laplace's 
equation. Doob |Doo59j gave a probabilistic interpretation in terms of Wiener pro- 
cesses and also an extension to the case when time is discrete. His method was to 
first establish an integral representation for super-harmonic functions and then to 
derive information about final behaviour of paths. Hunt |Hun60j showed that one 
could also take the opposite approach: establish the results concerning paths prob- 
abilistically and then deduce the integral representation. The approach taken in 
the present paper is closest to that of Dynkin |Dyn69| , which contains a simplified 
version of Hunt's method. 

There is a third approach to this subject, using Choquet theory. However, at 
present, the tools in the max-plus setting, arc not yet sufficiently developed to allow 
us to take this route. 

Our starting point is the max-plus analogue of the Green kernel, 

A*j sup{Aij,ii H h Ai„_ij,. I n e N, zq, . . . , i„ G S", «o = «, in ^ j} ■ 

Thus, A*j is the maximal weight of a path from i to j. We fix a map i l—^ ai, 
from 5 to M U {— cxd}, which will play the role of the reference measure. We set 
TTj := supj.gg (Tfc + Al,j. We define the max-plus Martin space ^ to be the closure 
of the set of maps := {A* — ttj | j G 5} in the product topology, and the Martin 
boundary to be ^ \ J€ . This term must be used with caution however, since 
may not be open in ^ (see Example 110. The reference measure is often chosen 
to be a max-plus Dirac function, taking the value at some basepoint 6 G S* and 
the value —oo elsewhere. In this case, iTj = AI-. 

One may consider the analogue of an "almost sure" event to be a set of outcomes 
(in our case paths) for which the maximum reward over the complement is — oo. 
So we are lead to the notion of an "almost-geodesic" , a path of finite total reward, 
see Section |7| The almost sure convergence of paths in the probabilistic case then 
translates into the convergence of every almost-geodesic to a point on the boundary. 

The spectral measure of probabilistic potential theory also has a natural ana- 
logue, and we use it to give a representation of the analogues of harmonic functions, 
the solutions of (Q). Just as in probabilistic potential theory, one does not need 
the entire Martin boundary for this representation, a particular subset, called the 
minimal Martin space, will do. The probabilistic version is defined in |Dyn69| to 
be the set of boundary points for which the spectral measure is a Dirac measure 
located at the point itself. Our definition (see Section Q is closer to an equivalent 
definition given in the same paper in which the spectral measure is required only to 
have a unit of mass at the point in question. The two definitions are not equivalent 
in the max-plus setting and this is related to the main difference between the two 
theories: the representing max-plus measure may not be unique. 

Our main theorem (Theorem 18.1(1 is that every (max-plus) harmonic vector u 
that is integrable with respect to tt, meaning that sup^g^ ttj + Uj < oo, can be 
represented as 



u = sup ^{w) + w, 



(2) 
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where v is an upper semicontinuous map from the minimal Martin space ^™ to 
]RU{— oo}, bounded above. The map v is the analogue of the density of the spectral 
measure. 

We also show that the (max-plus) minimal Martin space is exactly the set of 
(normalised) harmonic functions that arc extremal in the max-plus sense, see Theo- 
rcm l8.3l We show that each clement of the minimal Martin space is either recurrent, 
or a boundary point which is the limit of an almost-geodesic (see Corollary 17. 71 and 
Proposition l7.8|l . 

To give a first application of our results, we obtain in Corollarv lll.3l an existence 
theorem for non-zero harmonic functions of max-plus linear kernels satisfying a 
tightness condition, from which we derive a characterisation of the spectrum of 
some of these kernels fCorollarv lll.4|l . 

To give a second application, we obtain in Section 1121 a representation of the 
eigenvectors of the Lax-Olcinik semigroup |Eva98l §3.3]: 

T*u(x) = sup -tif^— ^) +it(2/) , 

where L is a convex Lagrangian. This is the evolution semigroup of the Hamilton- 
Jacobi equation 

where L* denotes the Legendre-Fenchel transform of L. An eigenvector with eigen- 
value A G M is a function u such that T^u ^ Xt + u holds for all < > 0. We 
compute the eigenvectors for a subclass of possibly nondifferentiable Lagrangians 
(Corollary [T2!31 and Theorem [lT5jl . 

Results and ideas related to the ones of present paper have appeared in several 
works: we now discuss them. 

Max-plus harmonic functions have been much studied in the finite-dimensional 
setting. The representation formula Q extends the representation of harmonic vec- 
tors given in the case when 5* is finite in terms of the critical and saturation graphs. 
This was obtained by several authors, including Romanovski |R,om67j . Gondran 
and Minoux |CM77| and Cuninghame- Green |CG79I Th. 24.9]. The reader may 
consult |MS92I [BUUC^ |Bap98| l(;Mn2l IHToHl IA(;W()4I for more background on 
max-plus spectral theory. Relations between max-plus spectral theory and infi- 
nite horizon optimisation are discussed by Yakovenko and Kontorer |YK92j and 
Kolokoltsov and Maslov |KM97I § 2.4]. The idea of "almost-geodesic" appears 
there in relation with "Turnpike" theorems. 

The max-plus Martin boundary generalises to some extent the boundary of a 
metric space defined in terms of (generalised) Busemann functions by Gromov 
in |(;ro81j in the following way (see also |H(;S85| and |Ral95l Ch. II]). (Note that 
this is not the same as the Gromov boundary of hyperbolic spaces.) If {S, d) is a 
complete metric space, one considers, for all y,x G S, the function 6j, given by 

by.x{z) = d{x, z) — d{x, y) for z G 5 . 

One can fix the basepoint y in an arbitrary way. The space "^{S) can be equipped 
with the topology of uniform convergence on bounded sets, as in jGro81[ lBal95j . 
or with the topology of uniform convergence on compact sets, as in |BGS85j . The 
limits of sequences of functions hy^x,, G 'rf{S), where Xn is a sequence of elements 
of S going to infinity, are called (generalised) Busemann functions. 
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When the metric space S is proper, meaning that all closed bounded subsets of 

5 are compact, the set of Busemann functions coincides with the max-plus Martin 
boundary obtained by taking A^^ = — — d(z,a;), and a the max-plus Dirac 
function at the bascpoint y. This follows from Ascoli's theorem, sec Remark 17.101 
for details. Note that our setting is more general since —A* need not have the 
properties of a metric, apart from the triangle inequality (the case when A* is not 
symmetrical is needed in optimal control). 

We note that Ballman has drawn attention in |Bal95l Ch. II] to the analogy 
between this boundary and the probabilistic Martin boundary. 

The same boundary has recently appeared in the work of Rieffel |Rie02| . who 
called it the metric boundary. Rieffel used the term Busemann point to desig- 
nate those points of the metric boundary that are limits of what he calls "almost- 
geodesics". We shall see in Corollary 17. 131 that these are exactly the points of the 
max-plus minimal Martin boundary, at least when S" is a proper metric space. We 
also relate Busemann points to extremal eigenvectors of Lax-Olcinik semigroups, in 
Section IT^ Rieffel asked in what cases are all boundary points Busemann points. 
This problem, as well as the relation between the metric boundary and other bound- 
aries, has been studied by Webster and Winchester |WW03b1 IWWOSa] and by 
Andreev |And04| . However, representation problems like the one dealt with in 
Theorem 18. II do not seem to have been treated in the metric space context. 

Results similar to those of max-plus spectral theory have recently appeared in 
weak-KAM theory. In this context, is a Riemannian manifold and the ker- 
nel A is replaced by a Lax-Oleinik semigroup, that is, the evolution semigroup 
of a Hamilton- Jacobi equation. Max-plus harmonic functions correspond to the 
weak-KAM solutions of Fathi jFat97bl [Fat97a FatOSaj, which are essentially the 
eigenvectors of the Lax-Oleinik semigroup, or equivalently, the viscosity solutions 
of the crgodic Hamilton- Jacobi equation, see |Fat03al Chapter 8]. In weak-KAM 
theory, the analogue of the Green kernel is called the Mane potential, the role of 
the critical graph is played by the Mather set, and the Aubry set is related to the 
saturation graph. In the case when the manifold is compact, Contreras [ConOll 
Theorem 0.2] and Fathi [ FatOSal Theorem 8.6.1] gave a representation of the weak- 
KAM solutions, involving a supremum of fundamental solutions associated to el- 
ements of the Aubry set. The case of non-compact manifolds was considered by 
Contreras, who defined an analogue of the minimal max-plus Martin boundary in 
terms of Busemann functions, and obtained in [ConOll Theorem 0.5] a representa- 
tion formula for weak-KAM solutions analogous to 0. Busemann functions also 
appear in |Fat03bj. Other results of weak-KAM theory concerning non-compact 
manifolds have been obtained by Fathi and Maderna |FM02j . See also Fathi and 
Siconolfi |FS04j . Extremality properties of the elements of the max-plus Martin 
boundary (Theorems 16.21 and 18.31 below) do not seem to have been considered in 
weak-KAM theory. 

Despite the general analogy, the proofs of our representation theorem for har- 
monic functions f Theorem 18. l|l and of the corresponding theorems in |(]on01| and 
|Fat03aj require different techniques. In order to relate both settings, it would be 
natural to set A = Bs, where {Bt)t>o is the Lax-Oleinik semigroup, and s > is 
arbitrary. However, only special kernels A can be written in this way, in particular 
A must have an "infinite divisibility" property. Also, not every harmonic function 
of Bs is a weak-KAM solution associated to the semigroup {Bt)t>o- Thus, the 
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discrete time case is in some sense more general than the continuous-time case, 
but eigenvectors are more constrained in continuous time, so both settings require 
distinct treatments. Nevertheless, in some special cases, a representation of wcak- 
KAM solutions follows from our results. This happens for example in Section IT21 
where our assumptions imply that the minimal Martin space of Ba is independent 
of s. We note that the Lagrangian there is not necessarily differentiablc. a property 
which is required in |Fat03aj and [ConOlj . 

The lack of uniqueness of the representing measure is examined in a further 
work |Wal05j . where it is shown that the set of (max-plus) measures representing 
a given (max-plus) harmonic function has a least element. 

We note that the main results of the present paper have been announced in the 
final section of a companion paper, |AGW04j . in which max-plus spectral theory 
was developed under some tightness conditions. Here, we use tightness only in 
Section im 

Acknowledgements. We thank Albert Fathi for helpful comments, and in particular 
for having pointed out to us the work of Contreras |('onOH . We also thank Arnaud 
de la FortcUe for references on the probabilistic Martin boundary theory. 

2. The max-plus Martin kernel and max-plus Martin space 

To show the analogy between the boundary theory of deterministic optimal con- 
trol problems and classical potential theory, it will be convenient to use max-plus 
notation. The max-plus semiring, Kmax, is the set R U {—00} equipped with the 
addition (a, 6) 1-^ a © & := max(a, b) and the multiplication {a,b) 1— > a 6 := a + &. 
We denote by (D —00 and 1 := the zero and unit elements, respectively. We 
shall often write ah instead of a &. Since the supremum of an infinite set may 
be infinite, we shall occasionally need to consider the completed max-plus semiring 
Kmax, obtained by adjoining to Kmax an element +00, with the convention that 
(D = — 00 remains absorbing for the semiring multiplication. 

The sums and products of matrices and vectors are defined in the natural way. 
These operators will be denoted by © and concatenation, respectively. For instance, 
if A £ Rmax'i {hi) ^ ^iji dcuotcs a matrix (or kernel), and if u £ I^maxi i ^ Ui 
denotes a vector, we denote by Au £ Kmaxi * ^ iAu)i, the vector defined by 

{Au)i := AijUj , 

where the symbol © denotes the usual supremum. 

We now introduce the max-plus analogue of the potential kernel (Green kernel). 
Given any matrix A £ K^^x^ , we define 

A* ^ I®A®A^ - € l^ax : 

A+ = A®A^ ®A^ e Wil^ 

where I ~ A^^ denotes the max-plus identity matrix, and A''' denotes the fcth power 
of the matrix A. The following formulae arc obvious: 

A*^I(BA+, A+^AA*^A*A, and A*^A*A*. 

It may be useful to keep in mind the graph representation of matrices: to any matrix 
A £ M^^;f is associated a directed graph with set of nodes S and an arc from i to 
j if the weight Aij is different from (D. The weight of a path is by definition the 
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max-plus product (that is, the sum) of the weights of its arcs. Then, A^- and A*j 
represent the supremum of the weights of aU paths from i to j that are, respectively, 
of positive an nonnegative length. 

Motivated by the analogy with potential theory, we will say that a vector u S 
^max (max-plus) harmonic if Au = u and super-harmonic if Au < u. Note that 
we require the entries of a harmonic or super-harmonic vector to be distinct from 
-l-oo. Wc shall say that a vector tt S K^ax is left (max-plus) harmonic if ttA = n, 
n being thought of as a row vector. Likewise, we shall say that tt is left (max-plus) 
super- harmonic if ttA < tt. Super- harmonic vectors have the following elementary 
characterisation. 

Proposition 2.1. A vector u G Kj^ax super-harmonic if and only if u = A*u. 

Proof. If u e I^max supcr-harmonic, then A'^u < u for all A: > 1, from which it 
follows that u = A*u. The converse also holds, since AA*u — A'^u < A*u. □ 

From now on, wc make the following assumption. 

Assumption 2.2. There exists a left super-harmonic vector with full support, in 
other words a row vector tt £ M.^ such that tt > ttA. 

By applying Proposition 12. II to the transpose of A, we conclude that tt = ttA*. 
Since n has no components equal to (D, we see that one consequence of the above 
assumption is that A*j g Kmax for all i,j G S. A fortiori, Aij € Mmax for all i,j G S. 

The choice of tt we make will determine which set of harmonic vectors is the 
focus of attention. It will be the set of harmonic vectors u that are n -integrable, 
meaning that ttu < oo. Of course, the boundary that we define will also depend 
on TT, in general. For brevity, we shall omit the explicit dependence on tt of the 
quantities that we introduce and shall omit the assumption on tt in the statements 
of the theorems. We denote by and S^, respectively, the set of 7r-integrable 
harmonic and 7r-integrable super-harmonic vectors. 

It is often convenient to choose tt := Al, for some 6 e 5. (We use the notation 
Mi. and M.i to denote, respectively, the ith row and zth column of any matrix M.) 
We shall say that & is a basepoint when the vector tt defined in this way has finite 
entries (in particular, a basepoint has access to every node in S). With this choice 
of TT, every super-harmonic vector u £ K^ax automatically 7r-integrable since, by 
Proposition 12. II ttu = {A*u)i, = ui, < +oo. So, in this case, coincides with the 
set of all harmonic vectors. This conclusion remains true when tt := aA* , where a 
is any row vector with finite support, that is, with at = (D except for finitely many 
i. 

We define the Martin kernel K with respect to tt: 

Kij := A*j{tTj)-^ for aU iJeS . (3) 

Since TTiA*j < {TTA*)j = tTj, we have 

Kij < (TTi)"^ for allij eS . (4) 

This shows that the columns K.j are bounded above independently of j. By Ty- 
clionoff's theorem, the set of columns := {K.j \ j £ S} is relatively compact in 
the product topology of I^max- The Martin space is defined to be the closure 
of J^. We call ^ := ^ \ J(f the Martin boundary. From ||2Jl and Q), we get 
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that Aw < w and ttw < 1 for all w G J^. Since the set of vectors with these two 
properties can be written 

{w <E M^jj^ I AijWj < Wi and -KkWk < 1 for all k £ S} 

and this set is obviously closed in the product topology of Kmaxi have that 

<Z and TTW < 1 for aU w G ^ . (5) 

3. Harmonic vectors arising from recurrent nodes 

Of particular interest are those column vectors of K that are harmonic. To 
investigate these we will need some basic notions and facts from max-plus spectral 
theory. Define the maximal circuit mean of A to be 

p{A) :=0(trA'=)i/'= , 
fe>i 

where trA = ©jgg^ii. Thus, p{^A) is the maximum weight-to-length ratio for 
all the circuits of the graph of A. The existence of a super-harmonic row vector 
with full support, Assumption l2.2l implies that p{A) < 1 (see for instance Prop. 3.5 
of |Dud92j or Lemma 2.2 of )AGW04j '). Define the normalised matrix A = p{A)^'^A. 
The max-plus analogue of the notion of recurrence is defined in |AGW04] : 

Definition 3.1 (Recurrence). We shall say that a node i is recurrent if A J = 1. 
We denote by N'^{A) the set of recurrent nodes. We call recurrent classes of A the 
equivalence classes of N'^{A) with the relation TZ defined by iTZj if = 1. 

This should be compared with the definition of recurrence for Markov chains, 
where a node is recurrent if one returns to it with probability one. Here, a node is 
recurrent if we can return to it with reward 1 in A. 

Since AA* = < A*, every column of A* is super- harmonic. Only those 
columns of A* corresponding to recurrent nodes yield harmonic vectors: 

Proposition 3.2 (See |AGW04| Prop. 5.1]). The column vector A* is harmonic 
if and only if p{A) = 1 and i is recurrent. □ 

The same is true for the columns of K since they are proportional in the max-plus 
sense to those if A* . 

The following two results show that it makes sense to identify elements in the 
same recurrence class. 

Proposition 3.3. Let i,j £ S be distinct. Then K.i = K.j if and only if p{A) = 1 
and i and j are in the same recurrence class. 

Proof. Let i,j G S* be such that K.i — K.j. Then, in particular, Ku ~ Kij, 
and so A*j ~ iTj{Tri)~^. Symmetrically, we obtain A*^ = Tri{7rj)^^. Therefore, 
A*, A*, =1. If i ^ j, then this imphes that Af, > Af.At = A*, A*, = 1, in which 
case p{A) = 1, i is recurrent, and i and j are in the same recurrence class. This 
shows the "only if" part of the proposition. Now let p{A) = 1 and i and j be in the 
same recurrence class. Then, according to )AGW04I Prop. 5.2], A*^ = A*jA*^, and so 
K.i = K.j{'Ki)~^-KjA*^. But since tt = ttA*, we have that tt^ > njA*.^, and therefore 
K.i < K.j. The reverse inequality follows from a symmetrical argument. □ 

Proposition 3.4. Assume that p{A) ~ 1. Then, for all u e and i, j in the 
same recurrence class, we have niUi — iTjUj. 
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Proof. Since tt G , we can consider the vector tt^^ := {TT^^)i^s- That tt is 
super-harmonic can be expressed as ttj > -KiAij, for all i,j G S. This is equivalent 
to (TTi)"^ > Ay(7rj)~^; in other words, that tt"^, seen as a column vector, is 
super-harmonic. Proposition 5.5 of |AGW04] states that the restriction of any 
two /9(j4)-super-eigenvectors of A to any recurrence class of A are proportional. 
Therefore, either m = (D or the restrictions of u and 7r~^ to any recurrence class are 
proportional. In either case, the map i G 5" iTiUi is constant on each recurrence 
class. □ 

Remark 3.5. It follows from these two propositions that, for any w G J?^, the map 
S Mmax, i I— > T^iUi induccs a map ^ — > Mmax, K-i T^iUi. Thus, a super- 
harmonic vector may be regarded as a function defined on J^. 

Let u G ^niax be a 7r-integrable vector. We define the map /in : ^ — » Rmax by 
fiuiw) := limsupTTjUj := inf sup TTjUj for w G , 

where the infimum is taken over all neighbourhoods of w in ./#. The reason 
why the limsup above cannot take the value -l-oo is that T^jUj < -ku < +oo for all 
j G S. The following result shows that '■ ^ — > Kmax is an upper semicontinuous 
extension of the map from Jif to Mmax introduced in Remark 13. 51 

Lemma 3.6. Let u be a tt -integrable super-harmonic vector. Then, jiuiK-i) — T^iUi 
for each i £ S and fiuiw)w < u for each w G y£ . Moreover, 

" = ® tiu{w)w ^ ^ tiu{w)w . 

Proof. By Proposition 12. II A*u = u. Hence, for all i E S, 

Wi = A*^uj = K.jTijUj . (6) 

We conclude that Ui > KijTTjUj for all i,j G S. By taking the limsup with respect 
to j of this inequality, we obtain that 

Ui > lim swp KijTTjUj > liminf Kij limsupTTjUj = Wifiuiw) , (7) 

for all w G ^ and i G S. This shows the second part of the first assertion of the 
lemma. To prove the first part, we apply this inequality with w = K.i. We get 
that Ui > Kii^uiK.i). Since Ka = (tt^)"^, we see that iTiUi > ^u{K.i). The reverse 
inequality follows from the definition of The final statement of the lemma 
follows from Equation ^ and the first statement. □ 

4. The minimal Martin space 

In probabilistic potential theory, one does not need the entire boundary to be 
able to represent harmonic vectors, a certain subset suffices. We shall see that 
the situation in the max-plus setting is similar. To define the (max-plus) minimal 
Martin space, we need to introduce another kernel: 

K^^^ ■=A+{tTj)-^ ioral\i,jeS . 
Note that K^^ = AK.j is a function of K.j. For all w G we also define G IR-max- 

w ■ = lim inf K^, for alH G 5 . 
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The following lemma shows that no ambiguity arises from this notation since 



Lemma 4.1. We have w' ~ w for w £ and = K^j = Aw for w = K.j G J^. 
For all w S we have £ and ■kvJ' < 1. 

Proof. Let w G Then, for each i G S, there exists a neighbourhood of w such 
that K., ^ W. So 

= lim inf K^j = lim inf Kij — Wi , 

proving that ^ w. 

Now let w ~ K.j for some j £ S. Taking the sequence with constant value K.j, 
we see that < K^j . To establish the opposite inequality, we observe that 

= liminf AA'.fc > lim inf A.iKjk = A.iWi for all i G S* , 

or, in other words, > Avu. Therefore we have shown that = K^j. 

The last assertion of the lemma follows from Q and the fact that tt is super- 
harmonic. □ 

Next, we define two kernels H and over 

H{z,w) :~fiw{z) = limsupTTiWi = lim sup lim HiKij 

K.i->z K.i^z K.j^w 

H^(z,w) :=^^b{z) ~ limsupTTiW,^ = lim sup liminf TTii^Tj^- . 

Using the fact that K'" < K and Inequality Q), we get that 

H\z,w) < H{z,w) <1 foraUw,zG.^. 

If ui G then both w and are elements of ^5^ by lO and Lemma f4. II Using 
the first assertion in Lemma 13.61 we get that 

H{K.i, w) = 'K^Wi (8) 

H\K.„w)=t:,w\ . (9) 

In particular 

K.j) = ^Jv,, = ^, A*^ (n,)-^ (10) 

H\K..„ K.j) = ^,At^. = ■ (11) 

Therefore, up to a diagonal similarity, H and are extensions to ^ x ^ of the 
kernels A* and respectively. 



Lemma 4.2. For all w, z £ 

H{z,w) 



(z, w) when w^zoiw = z£ 
1 otherwise . 



Proof, li w £ then = w hy Lemma [4.11 and the equality of H{z,w) and 
H^{z,w) for all z £ ^ follows immediately. 

Let w ~ K.j for some j £ S and let z £ ^ be different from w. Then, there exists 
a neighbourhood W oi z that does not contain w. Applying Lemma l4. II again, we 
get that w\ = K^ = Ki^ = for all i £W. We deduce that H{z, w) H^{z, w) 
in this case also. 



10 



MARIANNE AKIAN, STEPHANE GAUBERT, AND CORMAC WALSH 



In the final case, we have w = z E Jif . The result follows from Equation □ 
We define the minimal Martin space to be 

^™ -.^{we^ I H\w, w)^1} . 
From Lemma [4.21 we see that 

{w e ^ I i/(w,w) = 1} = ^™ U JT . (12) 
Lemma 4.3. Every w G U J(f satisfies ttw = 1. 
Proof. We have 

t:w ~ "awp-KiWi > limsupTTiiUi = H{w,w) = 1. 
ies K.i~*w 

By Equation ttw < 1, and the result follows. □ 
Proposition 4.4. Every element oj is harmonic. 

Proof. If -J^ n ^™ contains an element w, then, from Equation (|ll|l . we see that 
p{A) ~ 1 and w is recurrent. It follows from Proposition 13. 21 that w is harmonic. 

It remains to prove that the same is true for each element w oi S§ C\ 
Let i € S he such that Wi ^ Q and assume that /3 > 1 is given. Since w S 
w and K.i will be different. We make two more observations. Firstly, by 
Lemma 14.21 limsupj^ tt^Wj = 1. Secondly, limx. j Kij = Wi. From these 
facts, we conclude that there exists j € S, different from z, such that 

1 < (3TTjWj and w,, < fSK^j . (13) 

Now, since i and j are distinct, we have A*j ~ A^j ~ {AA*)ij. Therefore, we 
can find fc G S* such that 

A*, < f3A,Al^ . (14) 
The final ingredient is that A^^ Wj < Wk because w is super-harmonic. From this 
and the inequalities in H13|l and (|14|) . we deduce that Wi < P^Ai^Wk < P^{Aw)i. 
Both (3 and i are arbitrary, so w < Aw. The reverse inequality is also true since 
every element of ^ is super-harmonic. Therefore w is harmonic. □ 

5. Martin spaces constructed from different basepoints 

We shall see that when the left super-harmonic vector tt is of the special form tt = 
Al, for some basepoint b € S, the corresponding Martin boundary is independent 
of the basepoint. 

Proposition 5.1. The Martin spaces corresponding to different basepoints are 
homeomorphic. The same is true for Martin boundaries and minimal Martin 
spaces. 

Proof. Let ^ and denote the Martin spaces corresponding respectively to two 
different basepoints, b and b' . We set tt = A^, and tt' = A^,,. We denote by K and 
K' the Martin kernels corresponding respectively to tt and tt'. By construction, 
Kiij = 1 holds for all j € S. It follows that Wb = 1 for all w G Using 
the inclusion in Q, we conclude that C S^b := {w G ^ | Wb = 1}, where 
denotes the set of 7r-integrable super-harmonic functions. Observe that Al^ and Al,j 
are finite for all i,j G S, since both b and b' are basepoints. Due to the inequalities 
tt' > AltfjTT and tt > A^^/Tt', 7r-integrability is equivalent to 7r'-intcgrability. We 
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deduce that C S^v '■= {w' ^ y \ w'^^i — !}■ Consider now the maps and 
defined by 

Observe that if w € J^b, then Wb' > Alif^Wb = ^J/^ C. Hence, w Wb' docs not 
take the value (D on S^b- By symmetry, w' i— > does not take the value zero on 
S^b' ■ It follows that (j) and 4' are mutually inverse homeomorphisms which exchange 
yb and ^b'- Since (f> sends X.j to K',j, <j> sends the the Martin space which is 
the closure of := {K.j \ j e S}, to the Martin space which is the closure of 
J(f' := {K'j I j G S}. Hence, </> sends the Martin boundary ^ \ J(f to the Martin 
boundary \ Jf' . 

It remains to show that the minimal Martin space corresponding to tt, ./#"', is 
sent by (p to the minimal Martin space corresponding to tt', Let 

H'\z',w') =limsup \imM Al,,A+{A*b,.y^ . 

Since (f> is an homeomorphism sending K.i to K',^, a net {K.i)i^i converges to if if 
and only if the net {K[.j)i^i converges to 0(u'), and so 

H'\^{z),cp{w)) = limsup liminf = Zb:w-^H\z,w) . 

It follows that H^{w, w) = 1 if and only if H'^{(j)(w), (l){w)) = 1. Hence, (/)(^™) = 
^'™. □ 

Remark 5.2. Consider the kernel obtained by symmetrising the kernel ^ 

{z,w) ^ H\z,w)H^{w,z) . 

The final argument in the proof of Proposition 15.11 shows that this symmetrised 
kernel is independent of the basepoint, up to the identification of w and (f>{w). The 
same is true for the kernel obtained by symmetrising H, 

{z,w) 1-^ H{z,w)H{w, z) . 

6. Martin representation of super-harmonic vectors 

In probabilistic potential theory, each super-harmonic vector has a unique rep- 
resentation as integral over a certain set of vectors, the analogue of ^™ U J^. 
The situation is somewhat different in the max-plus setting. Firstly, according to 
Lemma 13.61 one does not need the whole of ^™ U ^ to obtain a representation: 
any set containing will do. Secondly, the representation will not necessarily be 
unique. The following two theorems, however, show that U still plays an 
important role. 

Theorem 6.1 (Martin representation of super-harmonic vectors). For each u € , 
flu is the maximal v : U Jif — > Mmax satisfying 

u = v{w)w , (15) 

Any V : ^™ U — > Kmax satisfying this equation also satisfies 

sup h'{w) < +00 (16) 

and any v satisfying fJ6)) defines by an element u of y . 
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Proof. By Lemma 13.61 u can be written as l|15() with v = /iu . Suppose that v : 
^™ U J(^ — > Mmax is an arbitrary function satisfying H15(l . We have 

TTU = h'(w)Tr'W . 

By Lemma 14.31 ttiu = 1 for each w £ U Since txu < +oo, we deduce 

that ^ holds. 

Suppose that v : U — > Mmax is an arbitrary function satisfying H16() 

and define u by H15() . Since the operation of multiphcation by A commutes with 
arbitrary suprema, we have Au < u. Also ttu = ®K,g^mujr ^('"') < +oo. So 

u e ^. 

Let w S U J^'. Then v{w)wi < Ui for all i ^ S. So we have 

h'(w)H{w,w) — limsupTTiWi < limsupTTiUi = fJ^uiw) . 

K.i — *u; K.i — 

Since H(w,w) = 1, wc obtain iy{w) < fiu{w). □ 

We shall now give another interpretation of the set U J^. Let F be a 

subsemimodule of M^^jj^^, that is a subset of K^ax stable under pointwise maximum 
and the addition of a constant (see |LMS01[|CGQ04| for definitions and properties 
of semimodules). Wc say that a vector ^ G ^ \ {©} is an extremal generator of V 
if ^ = w ® w with u^v £ V implies that either ^ = u or ^ = w. This concept has, 
of course, an analogue in the usual algebra, where extremal generators are defined 
for cones. Max-plus extremal generators are also called join irreducible elements in 
the lattice literature. Clearly, if ^ is an extremal generator of V then so is for 
all a G R. We say that a vector u S R^ax normalised if ttu = 1. If y is a subset 
of the set of 7r-integrable vectors, then the set of its extremal generators is exactly 
the set of a^, where a G R and ^ is a normalised extremal generator. 

Theorem 6.2. The normalised extremal generators of are precisely the elements 

o/.^" u jr. 

The proof of this theorem relies on a series of auxiliary results. 

Lemma 6.3. Suppose that ^ G ./#'" U J^^ can be written in the form ^ — 
®w£^ ^{w)w, where v : ^ Rmax is upper semicontinuous. Then, there ex- 
ists w G ./# such that ^ ~ v{w)w. 

Proof. For all i & S, we have = v{w)wi. As the conventional sum of two 

upper semicontinuous functions, the function ^ Rmax '■ w ^ v(w)wi is upper 
semicontinuous. Since ^ is compact, the supremum of v(w)wi is attained at some 
w^*' G in other words = i^{w'^^'>)wl^\ Since = 1, by definition of 

H, there exists a net {ik)keD of elements of S such that K.i^ converges to ^ and 
7rjj.^jj. converges to 1. The Martin space ^ is compact and so, by taking a subnet 
if necessary, we may assume that converges to some w G ^ . Now, for 

all j G S, 

since w^''-''' is super-harmonic. Taking the limsup as fc — > cx), we get that < 
v(w)wj. The reverse inequality is true by assumption and therefore = v(w)wj. 

□ 
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The following consequence of this lemma proves one part of Theorem 16. 21 
Corollary 6.4. Every element of \J J(f is a normalised extremal generator of 

Proof. Let ^ e ^™ U . We know from Lemma 14.31 that ^ is normalised. Li 
particular, ^ 7^ C. We also know from Equation jsj that ^ £ ,5^. Suppose u,w € ^ 
are such that ^ = u ® v. By Lemma [3.61 we have u = ^u{w)w and v = 

® we^ l^v{w)w. Therefore, ^ = v{w)w, with u = Ai„ ©/x^- Since yLt„ and /x^ 

are upper semicontinuous maps from ^ to Kmax, so is v. By the previous lemma, 
there exists w € ^ such that ^ = v(yj)w. Now, v{w) must equal either [i,u(w) or 
fj,v{w). Without loss of generality, assume the first case. Then ^ = ^iu{w)w < u, 
and since ^ > u, we deduce that ^ = u. This shows that ^ is an extremal generator 
of ^. □ 

The following lemma will allow us to complete the proof of Theorem 16. 21 

Lemma 6.5. Let ^ C Kfiax ^^'^'e compact closure in the product topology. 
Denote by V the set whose elements are of the form 

C ffi iy{w)w e Mfj^,,, with i/ : ^ -> R„iax, sup iy{w) < 00 . (17) 

Let ^ he an extremal generator ofV, and v he as in Then, there exists w ^ 

such that ^ = 0[w)w, where 

v{w) :~ limsup v{w'). 

w' — ^w. w' 

Proof. Since < />. we have ^ < v{w)w < i>{w)w. Clearly, v{w)wi < 

for all i G and w G Taking the limsup as w — > w' for any w' G , we get 
that 

> i>{w')Wi. 

Combined with the previous inequality, this gives us the representations 

^ = Hw)w ^ i){w)w . (18) 

Consider now, for each i G and a < 1, the set 

Uua {w G # I v{w)wi < a^J , 

which is open in J? since the map w > v{w)wi is upper semicontinuous. Let 
^ G y\{(D} be such that ^ ^ v{w)w for all w G . We conclude that there 
exist i € S and a < 1 such that a^i > v{w)wi, which shows that {Ui^a)i^s,a<i 
is an open covering of Since ^ is compact, there exists a finite sub-covering 

Using p8|) and the idcmpotcncy of the © law, we get 

C = ® ■ • ■ © r with f = i'{w)w , (19) 

for j = 1 . . . , n. Since the supremum of v over ^ is the same as that over ^ , the 
vectors . . . all belong to V. Since ^ is an extremal generator of =5^, we must 
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have ^ = for some j. Then Ui-^aj fl ^ is non-empty, and so > (D. But, from 
the definition of Ui-,aj, 

This shows that £j is different from ^, and so Equation (|f 9|l gives the required 
decomposition of ^, proving it is not an extremal generator of V . □ 

We now conclude the proof of Theorem 16.21 

Corollary 6.6. Every normalised extremal generator of belongs to ^™ U J(f . 

Proof. Takc_^ = U and let V be as defined in Lemma ESI Then, by 

definition, ^ = which is compact. By Theorem 16.11 V = ,5^ . Let be a 
normalised extremal generator of 5^. Again by Theorem 16.11 ^ = 0u,g^/xj(w)u'. 
Since /ij is upper semicontinuous on Lemma [6.51 yields ^ = fi^{w)w for some 
w e with fJ.^(w) (D since ^ 7^ ©. Note that ^au = otjjLu for all a £ Mmax and 
u € S^. Applying this to the previous equation and evaluating at w, we deduce that 
/i^(u') = ^({w)^wiw). Thus, H{w,w) = fJ,wiw) = 1- In addition, ^ is normalised 
and so. by Lemma 14.31 

Hence ^ = w G U .yT. □ 



7. Almost-geodesics 

In order to prove a Martin representation theorem for harmonic vectors, we will 
use a notion appearing in |YK92j and |KM97I § 2.4], which we will call almost- 
geodesic. A variation of this notion appeared in |Rie02j . We will compare the two 
notions later in the section. 

Let u be a super-harmonic vector, that is u S R,nax ^ L^t a e K„iax 

be such that a > 1. We say that a sequence {ik)k>o with values in 5* is an a- 
almost- geodesic with respect to u if Ui^ € M and 

Uio < aAigi^ ■ ■ ■ Ai^_^i^Ui^ for aU A: > . (20) 

Similarly, {ik)k>o is an a-almost-geodesic with respect to a left super-harmonic 
vector a if G M and 

ai^ < aai^Aigi^ ■ ■ ■ Ai^_-^i^ for all k>0 . 

We will drop the reference to a when its value is unimportant. Observe that, if 
(*fe)fe>o is an almost-geodesic with respect to some right super-harmonic vector u, 
then both Ui^, and are in M for all fc > 0. This is not necessarily true 

if (*fc)fe>o is an almost-geodesic with respect to a left super-harmonic vector a, 
however, if additionally G K. for all fc > 0, then G M for all k > 0. 

Lemma 7.1. Let u, a G K^ax respectively, right and left super- harmonic vectors 
and assume thatu is a-integrahle, that is an < +00. If (ik)k>o is an almost-geodesic 
with respect to u, and if (Jig G M, then (ik)k>o is o,n almost- geodesic with respect to 
a. 
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Proof. Multiplying Equation (|20(l by ai^ {ui„ ) ^ , we obtain 



So {ik)k>o is a /3-alinost-geodesic with respect to cr, with /3 := a{au){(JigUig) ^ > 
a. □ 

Lemma 7.2. Let {ik)k>Q be an almost-geodesic with respect to tt and let /3 > 1. 
Then, for £ large enough, {ik)k>e is a (3-almost-geodesic with respect to ir. 

Proof. Consider the matrix Aij := TriAij{Trj)^^ . The fact that {ik)k>a is an a- 
almost-geodesic with respect to tt is equivalent to 

Pk ■■= (Ani)"^ • • • iAtk-ii^y^ < a for all fc > . 

Since (^i^.^ij"^ > 1 for all i > 1, the sequence {pk}k>i is nondecreasing. The 
upper bound then implies it converges to a finite limit. The Cauchy criterion states 
that 

lim Ai.i- ■ ■ ■ Ai i = 1 . 

i,k-^oo,i<k + 

This implies that, given any > 1, Ai^i^^^ ■ • ■ Ai^_-^i^ > for k and £ large 
enough, with k > £. Writing this formula in terms of A rather than A, we see that, 
for £ large enough, {ik)k>e is a /3-almost-geodesic with respect to tt. □ 

Proposition 7.3. // {ik)k>o is an almost-geodesic with respect to tt, then K.i^, 
converges to some w £ ^™ . 

Proof. Let /3 > 1. By Lemma IT!^ {ik)k>i is a /3-almost-geodesic with respect to tt, 
for £ large enough. Then, for all k > £, 

TT,, < /37r,,A+,^ < |3^T^lAl,^ . 

Since tt is left super-harmonic, we have Tri^^*,,^ < TTi,. Dividing by /^Tr.ij. the former 
inequalities, we deduce that 

< 7r.,<,, < TT,,K,,,, < 1 . (21) 

Since ^ is compact, it suffices to check that all convergent subnets of K.i^, have 
the same limit w G ^™ . Let {ik^)deD and {ii^)e&E denote subnets of (u-)fc>o, such 
that the nets {K.i^, )d^D and {K-i^ )eG-E converge to some w € and w' G 
respectively. Applying (|21|1 with £ ^ and k ~ kd, and taking the limit with 
respect to d, we obtain < TTi, . Taking now the limit with respect to 
e, we get that f3~^ < H{w' ,w). Since this holds for all /3 > 1, we obtain 1 < 
H{w' ,w), thus H(w' ,w) = 1. From Lemma f3. 61 we deduce that w > ^yj{w')w' = 
H{w',w)w' = w' . By symmetry, we conclude that w = w' , and so H{w,w) = 1. 
By Equation (O, w £ ^™ U JT. Hence, (if.ij fe>o converges towards some w G 

Assume by contradiction that w ^ Then, w = K.j for some j G 5, and 

H^{w,w) < 1 by definition of By this imphes that tt^K^^^ = A+- < 1. 

If the sequence {ik)k>a takes the value j infinitely often, then, we can deduce 
from Equation (|21|l that A^- = 1, a contradiction. Hence, for k large enough, ik 
does not take the value j, which implies, by Lemma 14.11 that Wi, = w^,. Using 
Equation H21|l . we obtain H^{w, w) > \\ms\xp^.^^ TTi,w\^ — VmiS\rpj,_^^ '^ik'^^ik — 
which contradicts our assumption on w. We have shown that w G □ 
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Remark 7.4. An inspection of the proof of Proposition 17.31 shows that the same 
conclusion holds under the weaker hypothesis that for all /? > 1, we have tt^j. < 
PiTi^A^^-^ for all £ large enough and k > £. 

Lemma 7.5. // {ik)k>o almost-geodesic with respect to tt, and if w is the 

limit of K.i^, then 

hm TTij^m;^ = 1 . 

k — >oo 

Proof. Let /3 > 1. By Lemma 17!^ {ik)k>t is a /3-almost-geodesic with respect to tt 
for i large enough. Hence, for all k > i, nt^ < Piri^A*^^^ , and so 1 < f3TTii,A*^^^Tr^^^ ~ 
p-iTi^Ki^if. . Since Ki^i^ converges to Wi^ when k tends to infinity, we deduce that 1 < 
P lim inf^^tx) TTi^ Wi^. , and since this holds for all /3 > 1, we get 1 < lim iidi^oo T^ii Wii ■ 
Since TTjWj < 1 for all j, the lemma is proved. □ 

Proposition 7.6. Let u be a tt -integrable super-harmonic vector. Then, ^„ is 
continuous along almost-geodesics, meaning that if {ik)k>o is an almost-geodesic 
with respect to tt and if K.i^ tends to w, then, 

fiuiw) = lim ^iu{K.i^) = lim TTi^Ui^ . 

k — *oo k — *oo 

Proof. Recall that iTiUi = iiu{K-i) holds for all i, as shown in Lemma |3.6I It also 
follows from this lemma that u > fiuiw)w, and so TTiUi > TTiWi^u{w) for a-U i (z S. 
Hence, 

lim inf TTi^ u,^ > lim inf TTi^ /i„ (w) 

k — *oo k — 'oo 

= t^u{w) , 

by Lemma [731 Moreover, limsupj._,oQ '^ik'^ik — l^u{w), by definition of ^u(w). □ 
Combining Lemma l7. II and Proposition we deduce the following. 

Corollary 7.7. If{ik)k>o is an almost- geodesic with respect to a tt -integrable super- 
harmonic vector, then K.i^ converges to some element of .y^™ . 

For brevity, we shall say sometimes that an almost-geodesic (ik)k>o converges to 
a vector w when K.i^, converges to w. We state a partial converse to Proposition l7.3l 

Proposition 7.8. Assume that ./# is first- countable. For all w € ./#™, there exists 
an almost-geodesic with respect to tt converging to w. 

Proof. By definition, H^{w, w) = 0. Writing this formula explicitly in terms of Aij 
and making the transformation Aij :— TTiAij{TTj)~^ , we get 

lim sup lim inf A^- = 1 . 

Fix a sequence (afc)fe>o in '^max such that > 1 and a := aoai ■ ■ ■ < +oo. Fix 
also a decreasing sequence {Wk)k>o of open neighbourhoods of w. We construct a 
sequence {ik)k>o in S inductively as follows. Given ik-i, we choose ik to have the 
following three properties: 

(a) K.,, eWk, 

(b) liminf K J -^w Af^ J > 
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Notice that it is possible to satisfy © because ik-i was chosen to satisfy IQ) at the 
previous step. We require iq to satisfy ijHj) and (0 but not (0). Since ^ is first- 
countable, one can choose the sequence (Wk)k>o in such a way that every sequence 
{'Wk)k>o in ^ with Wk G Wk converges to w. By Q, one can find, for all A; G N, a 
finite sequence iik)o<i<Nk such that = ik, ik'° = and 

AjO ^1 • • • A.jv^-i > ar""" for all fc G N . 

Since Aij < 1 for all i,j G 5, we obtain 

A,o ,1 • ■ • > a7^ for all fc G N, 1 < n < TVfc . 

Concatenating the sequences {ik)o<i<NkJ obtain a sequence {jm)m>o such that 
< Ajgj-^ ■ ■ for all m G N, in other words an a-almost-geodesic with 

respect to tt. From Lemnia l7.HI we know that K.j^ converges to some point in 
Since (ik) is a subsequence of (jVn) and K.i^ converges to w, we deduce that K-j^ 
also converges to □ 

Remark 7.9. If S is countable, the product topology on ^ is metrisable. Then, 
the assumption of Proposition 17. 81 is satisfied. 

Remark 7.10. Assume that {S,d) is a metric space, let Aij = A*j = ~d{i,j) for 
«,j G S', and let tt = Al, for any b e S. We have = -d{-,j) + d{b,j). Using 
the triangle inequality for d, we see that, for all k £ S, the function K.k is non- 
expansive, meaning that \Kik — Kjk\ < d{i,j) for all i,j G S. It follows that 
every map in ^ is non-expansive. By Ascoli's theorem, the topology of pointwise 
convergence on ^ coincides with the topology of uniform convergence on compact 
sets. Hence, if S* is a countable union of compact sets, then is metrisable and 
the assumption of Proposition 17. 81 is satisfied. 

Example 7.11. The assumption in Proposition 17.81 cannot be dispensed with. To 
see this, take S = cui, the first uncountable ordinal. For all i,j G 5, define Aij :~ 
if i < j and Aij := — 1 otherwise. Then, p{A) = 1 and A = A+. Also Aij equals 
when i < j and —1 otherwise. We take tt := A^., where denotes the smallest 
ordinal. With this choice, tt^ = 1 for all i G 5, and K ^ A*. 

Let ^ be the set of maps S { — 1,0} that are non-decreasing and take the 
value at 0. For each z G ^, define s{z) := sup{i G S \ Zi = 0} € S U {wi}. Our 
calculations above lead us to conclude that 

■jr ^ {z e ^ \ s{z) G S and = 0} . 

We note that ^ is closed in the product topology on {— 1,0}'^ and contains J^. 
Furthermore, every z G \ is the limit of the net {A*j)d£D indexed by the 
directed set Z) = {rf G 5 | d < Sz}- Therefore the Martin space is given by 
^ = ^ . Every limit ordinal 7 less than or equal to wi yields one point z^ in the 
Martin boundary := ^ \ Ji^: we have = for i < 7, and zj = —\ otherwise. 

Since A^^ = An = —1 for all i G S*, there are no recurrent points, and so J^fl^™ 
is empty. For any z G we have z^ = for all d < s{z). Taking the limsup, we 
conclude that H{z, z) = 1. thus ^™ = 3§. In particular, the identically zero vector 
is in 

Since a countable union of countable sets is countable, for any sequence (ife)fcGN 
of elements of S, the supremum / = supj,gf^ ik belongs to 5, and so its successor 
ordinal, that we denote by / + 1, also belongs to S. Since limfe^oo Ki+i^i^ — — 1, 
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K.i^ cannot converge to z"^ , which shows that the point z^'^ in the minimal Martin 
space is not the hmit of an almost-geodesic. 

We now compare our notion of almost-geodesic with that of Rieffel jRie02j in 
the metric space case. We assume that {S, d) is a metric space and take Aij = 
A*j = —d{i,j) and tTj = —d{b,j), for an some b G S. The compactification of S 
discussed in |Rie02| . called there the metric compactification, is the closure of J^^ 
in the topology of uniform convergence on compact sets, which, by Remark 17. 101 is 
the same as its closure in the product topology. It thus coincides with the Martin 
space We warn the reader that variants of the metric compactification can be 
found in the literature, in particular, the references |Gro81in3al95| use the topology 
of uniform convergence on bounded sets rather than on compacts. 

Observe that the basepoint b can be chosen in an arbitrary way: indeed, for all 
b' G S, setting tt' = Al,,, we get tt' > ^j/^tt and tt > A^^,7r', which imphes that 
almost-geodesics in our sense are the same for the basepoints b and b' . Therefore, 
when speaking of almost-geodesics in our sense, in a metric space, we will omit the 
reference to tt. 

Rieffel defines an almost-geodesic as an ^-valued map 7 from an unbounded set 
T of real nonnegative numbers containing 0, such that for all e > 0, for all s e T 
large enough, and for alH G T such that t > s, 

M(7(t),7(s))+d(7(s),7(0))-t| <e . 

By taking t ~ s, one sees that \d{'-f{t),j{Q)) — <| < e. Thus, almost-geodesics in the 
sense of Rieffel are "almost" parametrised by arc-length, unlike those in our sense. 

Proposition 7.12. Any almost-geodesic in the sense of Rieffel has a subsequence 
that is an almost-geodesic in our sense. Conversely, any almost-geodesic in our 
sense that is not bounded has a subsequence that is an almost- geodesic in the sense 
of Rieffel. 

Proof. Let ^ : T ^ S denote an almost-geodesic in the sense of Rieffel. Then, for 
all /? > 1, we have 

^7(0),7(t) - ^^7(0),7(s)^7(s)7(t) (^2) 

for all s G T large enough and for alH G T such that t > s. Since the choice of the 
basepoint b is irrelevant, we may assume that 6 = 7(0), so that '^■y{s) ~ ^7(0) 7(3)- 
As in the proof of Lemma 17.21 we set Aij ~ niA^jirJ^ . Wc deduce from (|22|l that 

/?~^ < A(«)7(t) < 1 ■ 

Let us choose a sequence /3i,/?2, ■ • ■ > 1 such that the product /3if32 . . ■ converges 
to a finite limit. We can construct a sequence to < < • . • of elements of T such 
that, setting ik ~ "/{ti^), 

Then, the product Ai^i^Ai-^i^ ■■■ converges, which implies that the sequence iq, 
ii, . . . is an almost-geodesic in our sense. 

Conversely, let io,«i,... be an almost-geodesic in our sense, and assume that 
tk = d{b,ik) is not bounded. After replacing ik by a subsequence, we may assume 
that to < ^1 < • ■ •• We set T — {to, ti, . . .} and ^{tk) = ik. Wc choose the basepoint 
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6 = lo, SO that io = e T, as required in the definition of Rieffel. Lemma l? . 2l imDUes 
that 

holds for all ^ large enough and for all k > £. Since t'^^ = ^lik^ T almost- 
geodesic in the sense of Rieffel. □ 

Rieffel called the limits of almost-gcodesics in his sense Busemann points. 

Corollary 7.13. Let S be a proper metric space. Then the minimal Martin space 
is the disjoint union of J(f and of the set of Busemann points of S . 

Proof. Since Af^ = —d{i,i) = for all i, the set is included in the minimal 
Martin space We next show that \ is the set of Busemann points. 

Let w G .J{ be a Busemann point. By Proposition 17. 12l we can find an almost- 
geodesic in our sense io,«i,... such that K.i^, converges to w and d{b,ik) is un- 
bounded. We know from Proposition 17.31 that w € It remains to check that 
w ^ J^. To see this, we show that for all z G 

lim H{K.i^,z) ^ H{w,z) . (23) 

k — >oo 

Indeed, for all (3 > 1, letting k tend to infinity in (|21|1 and using (jHJ, we get 

f3^^ < TTiiWi^ = H{K.i^,w) < 1 , 

for £ large enough. Hence, limf^oo H{K.i^, w) = 1. By Lemma [3.61 z > H{w, z)w. 
We deduce that H{K.i^,z) > H{w, z)H{K.i^,w), and so liminff^oo -^(-fi' if , -z) > 
H(w,z). By definition of iJ, \\Ta.svipi_,^H{K.ii,,z) < limsup H{K.j, z) = 
H{w,z), which shows H23|l . Assume now that w G J(^, that is, w = K.j for some 
j e S, and let us apply to z = K.b. We have H{K.i^,z) = Al-^A*^^ = -2 x 
d{b,ik) -oo. Hence, H{w,z) = -oo. But H{w,z) = ^l^^jb = -2 x d{b,j) > 
— (X), which shows that w ^ ,J€ . 

Conversely, let w G Ji™ \ By Proposition [731 w is the limit of an almost- 
geodesic in our sense. Observe that this almost-geodesic is unbounded. Otherwise, 
since S is proper, would have a converging subsequence, and by continuity of 
the map i i— » if.,;, we would have w G .X^ ^ a contradiction. It follows from Proposi- 
tion]^^] that w is a Busemann point. □ 



8. Martin representation of harmonic vectors 

Theorem 8.1 (Poisson-Martin representation of harmonic vectors). Any element 
u G can be written as 

u= iy{w)w , (24) 

with V : — > Mmaxj O'Tt'd necessarily, 

sup iy{w) < +CO . 

Conversely, any v : y^"^ — > Kmax satisfying the latter inequality defines by 
element u of .Jif. Moreover, given u G M' , fiu *s the maximal v satisfying 
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Proof. Let u G Jif. Then u is also in and so, from Lemma 13.61 we obtain that 
" = ® t^u{w)w > ^ ^J,u{■w)w . (25) 

To show the opposite inequality, let us fix some i G S such that Ui ^ (D. Let us 
also fix some sequence {ak)k>o h^ I^max such that > 1 for all fc > and such 
that a := agai ■ ■ ■ < +oo. Since u = Au, one can construct a sequence {ik)k>o in 
S starting at io := «, and such that 

u^, < akA,^,,^^Ui^^^ for all /c > . 

Then, 

Uio < a^^on ■ ■ ■ < Oi^iot^Utk for aU fc > , (26) 

and so {ik)k>o is an a-almost-geodesic with respect to u. Since u is 7r-integrable, 
we deduce using Corollary 17. 71 that K.i^, converges to some w € From (|26|l . 

we get Ui < aKii^'Ki^Ui^, and letting k go to infinity, wc obtain Ui < awifiuiw). 
We thus obtain 

Ui <a ^ Hu{w)wi . 

Since a can be chosen arbitrarily close to 1, we deduce the inequality opposite 
to H25() . which shows that H24|l holds with v = jiu- 

The other parts of the theorem arc proved in a manner similar to Thcorem l6.1l 

□ 

Remark 8.2. The maximal representing measure /in at every point that is the limit 
of an almost geodesic can be computed by taking the limit of TTiUi along any almost- 
geodesic converging to this point. See Proposition 

In particular, = {C} if and only if ^™ is empty. We now prove the analogue 
of Theorem 16. 21 for harmonic vectors. 

Theorem 8.3. The normalised extremal generators of are precisely the elements 
ofJ^'"'. 

Proof. We know from Theorem 16.21 that each element of ./#™ is a normalised ex- 
tremal generator of y. Since C ^, and ^™ C (by Proposition lOj) , this 
implies that each element of is a normalised extremal generator of . 

Conversely, by the same arguments as in the proof of Corollary 16.61 taking 
,^ = in Lemma 16.51 and using Theorem 18.11 instead of Lemma 13.61 we get 

that each normalised extremal generator ^ of belongs to ^™ U J(f . Since, by 
Proposition l3.2l no clement of ,J^\^"'' can be harmonic, wc have that ^ S . □ 

Remark 8.4. Consider the situation when there are only finitely many recurrence 
classes and only finitely many non- recurrent nodes. Then J(f is a finite set, so 
that -SS is empty, ^ = Jf , and ^™ coincides with the set of columns K.j with j 
recurrent. The representation theorem fThcorcm 18.11) shows in this case that each 
harmonic vector is a finite max-plus linear combination of the recurrent columns of 
A* , as is the case in finite dimension. 
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9. Product Martin spaces 

In this section, wc study the situation where the set S is the Cartesian product 
of two sets, and 52, and A and tt can be decomposed as follows: 

A = Al /2 ® /l ® ^2 , TT = TTl (g) 7r2 . (27) 

Here, (8) denotes the max-plus tensor product of matrices or vectors, Ai is an Si x Si 
matrix, tt^ is a vector indexed by 5*^, and li denotes the Si x Si max-plus identity 
matrix. For instance, {Ai <8> /2)(ii,i2),0i J2) = (^i)nii (-^2)12^2 > which is equal to 
(Ai)ijjj if 12 = j2, and to (D otherwise. We shall always assume that iTi is left super- 
harmonic with respect to Ai, for i ~ 1,2. We denote by ^i the corresponding 
Martin space, by Ki the corresponding Martin kernel, etc. 
We introduce the map 

I : Mf4^ X Mf^^^ ^ Mf,^^, 2(^1,^2) = wi ® W2 , 

which is obviously continuous for the product topologies. The restriction of i to the 
set of (wi, W2) such that ttiWi = 1:2^2 = 1 is injective. Indeed, if wi®W2 = w'i®W2, 
applying the operator Ii ® t^2 on both sides of the equality, we get wi ® 7121^2 = 
w'l ® '^2^2, from which we deduce that wi — w'l if tt2W2 = t^2W2 = 1- 

Proposition 9.1. Assume that A and tt are of the form {21^ , and that iTiWi ~ 1 
for all Wi G and i ~ 1,2. Then, the map i is a homeomorphism from ^\ x j^2 
to the Martin space ^ of A, and sends x J^2 to . Moreover, the same map 
sends 

X (jr2 U .^2") U (JTi U X 
to the minimal Martin space ^™ of A. 

The proof of Proposition 19 . II relies on several lemmas. 

Lemma 9.2. If A is given by fF^ , then, A* ~ Al (g) A^ and 

A+ = A+ ® A*2® Al® A+ . 

Proof Summing the equalities A'^ = 0i<f</c A{ (g) ^2"^, we obtain A* = A^ ® A^. 
Hence, A+ = AA* = (Ai (g) h ® h ® A2){Al ® A^) = A+ (g) A^ ® Al (g) A+ . □ 

We define the kernel Hoi from x^2)^ to Mmax, by Hoi{{zi, Z2), (wi, W2)) = 
H{i(zi, Z2), i{wi, 1^2))- The kernel o z is defined from in the same way. 

Lemma 9.3. // A* = AI ® A^ and tt = tti (g) 1:2, then = t{Xi x ^^2) and 
X ..#2) = Moreover, if TTiWi = 1 for all wt S and i = 1,2, then i is 
an homeomorphism from x ^2 to ^ , and H o i = Hi ® H2 ■ 

Proof. Observe that K = Ki g) K2. Hence, J(f ~ i(J^ x ^). Let X denote the 
closure of any set X. Since Jti = ^i, we get ,J^\ x J^2 = ^\ x ^2, and so J^i x J^2 
is compact. Since i is continuous, we deduce that x ,^2) = x ^). 

Hence, x ^2) = — ■ Assume now that HiWi = 1 for all Wi £ 

and i ~ 1,2, so that the restriction of i to ^\ x ^2 is injective. Since ^\ x ^2 
is compact, we deduce that i is an homeomorphism from ^\ x ^2 to its image, 
that is, Finally, let z — i{zi,Z2) and w ~ i{wi,W2), with zi,wi G ^\ and 
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Z2tW2 G ^2- Since i is an homeomorphism from x ^2 to we can write 
-ff (z, w) in terms of limsup and limit for the product topology of x ^2'- 

H{z,w)^ limsup lim 7r(j^.j2)ii'(,^.j^).(j^j3) . (28) 

(if2).i2— 22 (-'^2).J2-»«'2 

Since A* = A2 and tt = tti (g) 7r2, we can write the right hand side term of H28|) 
as the product of two terms that arc both bounded from above: 

'^{il,i2)^{il,i2),Uid2) ((^OilC-f'^'On Jl) ((7^2)12 (-^2)i2,i2) • 

Hence, the limit and limsup in (|28|l become a product of limits and limsups, re- 
spectively, and so H{z,w) = Hi{zi,wi)H2{z2,W2)- D 

Lemma 9.4. Assume that A and tt are of the form {2T\ ) and that niWi = 1 for all 
Wi € and i = 1,2. Then 

oi = h{®H2®Hi®hI . (29) 
Proof By Lemma lO A+ ^ A'^ ® A^ (B Al ® A^ , and so 

= kI ®K2®Ki®K^2 . 

Let z — i(zi,Z2) and w = i{wi,W2), with zi,wi £ 22,^2 G ./#2- In a way 
similar to (|28|l . we can write TJ'' as 

H\z,w)^ limsup hniinf 7r(,^,,,)ii:|'^^,^^)_(^-^ . 
The right hand side term is a sum of products: 

^{ii,i2)^\iiA2)A3i:h) ^ (7^2)12 (^"^'2)42^2 ® (7^2)12 (^2)j2i2 • 

We now use the following two general observations. Let {ad)deD, iPe)e<£E, ild)deD, 
iSe)e<aE be nets of elements of Rmax that are bounded from above. Then, 

limsup ad/3e ®Jd^e ~ (Km sup a^) (lim sup /3e) © (lim sup 7^) (lim sup (5e) . 

rf,e d e d e 

If additionally the nets (/3e)eG-E and (7^)^6-0 converge, we have 

lim inf adf3e ® JdSe = (hm inf a^) (hm p^) © (hm 7^) (lim inf S^) ■ 

d.e d e d e 

Using both identities, we deduce that is given by H29() . □ 

Proof of Provosition \y.l\ We know from Lemma that A* ~ A\ ® A2, and so, 
by Lemma 19.31 i is an homeomorphism from x ^2 to ^ . Since the kernels 
Hi,H\,H2 and H\ all take values less than or equal to 1, we conclude from H29() 
that, when z = 1(21,^2), H^{z,z) = 1 if and only if H\{zi^zi) = H2{z2,Z2) = 1 or 
Hi{zi,zi) = H2{z2, Z2) = 1. Using Equation (|12|l and the definition of the minimal 
Martin space, we deduce that 

J^"" = X (^2 U ^2") U (JTi U ^1") X ^2") . □ 

Remark 9.5. The assumption that iTiWi ~ 1 for all Wi G is automatically 
satisfied when the left super-harmonic vectors tt^ originate from basepoints, that is, 
when TTi = {Ai)l, . for some basepoint bi. Indeed, we already observed in the proof 
of Proposition 15.11 that every vector m; G satisfies {ni)bi{'Wi)bi = 1- By |(SJ), 
TTiWi < 1. We deduce that iTiWi = 1. 
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Remark 9.6. RiefFel |Rie02l Prop. 4.11] obtained a version of the first part of 
Lemma liO for metric spaces. His result states that if (5*1, di) and (52, 0^2) are 
locally compact metric spaces, and if their product S is equipped with the sum 
of the metrics, rf((ii,i2), (ji, J2)) = + '^2(^2, ^2), then the metric com- 

pactification of S can be identified with the Cartesian product of the metric com- 
pactifications of and S2 ■ This result can be re-obtained from Lemma 19.31 by 
taking (^i)iij. = (^2)j2j2 = -rf2(i2,j2), T^h = and 

TTi^ = — (i(«2,^2), for arbitrary basepoints 61,62 G ^- We shall illustrate this in 
Example [TTri 

10. Examples and Counter-Examples 

We now illustrate our results and show various features that the Martin space 
may have. 

Example 10.1. Let 5 = N, = for aU i e N, Ai,o = -1 for aU i e N \ {0} 

and Aij = —00 elsewhere. We choose the basepoint 0, so that ir — Aq .. The graph 
of A is; 




o 



States (elements of S) are represented by black dots. The white circle represents the 
extremal boundary clement ^. that we next determine. In this example. p{A) = 1, 
and A has no recurrent class. We have A*, = 1 for i < / and A*, = — 1 for i > /, so 
the Martin space of A corresponding to tt = A^. consists of the columns A*^, with 
i G N, together with the vector ^ whose entries are all equal to 1. We have = {^}. 
One can easily check that H{^,^) = 1. Therefore, = {£,}. Alternatively, we 
may use Proposition 17.31 to show that ^ e .z^™, since ^ is the limit of the almost- 
geodesic 0, 1, 2, . . .. Theorem 18. II savs that ^ is the unique (up to a multiplicative 
constant) non-zero harmonic vector. 

Example 10.2. Let us modify Example 1 1 . II by setting ^00 = 0, so that the previous 
graph becomes: 






o 



We still have p{A) ~ 1, the node becomes recurrent, and the minimal Martin 
space is now — {K.q,^}, where ^ is defined in Example 110.11 Theorem 18.11 

says that every harmonic vector is of the form aK.oOP^, that is sup(a + A'.o, P + O 
with the notation of classical algebra, for some a, /3 £ R U {—00}. 

Example 10.3. Let 8 — 2,, ^i.i+i ~ ^i+i.i = ^1 for i e Z, and Ay = (D elsewhere. 
We choose to be the basepoint, so that tt = Aq .. The graph of A is: 

o - — — - o 

We are using the same conventions as in the previous examples, together with the 
following additional conventions: the arrows are bidirectional since the matrix is 
symmetric, and each arc has weight —1 unless otherwise specified. This example 
and the next were considered by Rieffel |R ie02| . 
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We have p{A) = — 1 < 1, which imphes there are no recurrent nodes. We have 
A* j — —\i — j\, and so Ki j ~ \j\ — |i — j\. There are two Martm boundary 
points, ^+ = Unij_,oo K.j and ^~ = hmj_>_oo K.j, which are given by = i and 
^~ = —i. Thus, the Martin space is homcomorphic to Z := ZU {±00} equipped 
with the usual topology. Since both ^+ and ^~ are limits of almost-geodesics, 
-^"^ = {C^7^ }• Theorem 18.11 savs that every harmonic vector is of the form 
a^^ © (3^^ , for some a,P £ M^ax- 

Example 10.4. Consider S" := Z x Z and the operator A given by (j ^j-x-) = — 1 
and A(j j-) = —1, for each i,j E Z, with all other entries equal to —00. We 

choose the basepoint (0, 0). We represent the graph of A with the same conventions 
as in Example I ID. 31 

o 0000 o 





O o 

For all i,j, k,l E 

A*,,j),ikj)=-\i-k\-\j -l\ ■ 
Note that this is the negative of the distance in the £1 norm between and 
{k, I). The matrix A can be decomposed as A = Ai ® I (B I <^ A2, where Ai,A2 are 
two copies of the matrix of Example I ID. 31 and / denotes the Z x Z identity matrix 
(recall that ^ denotes the tensor product of matrices, see Section for details). 
The vector tt can be written as tti (g)7r2, with tti = {Ai)q . and 7r2 = (^2)0 ■■ Hence, 
Proposition l9 . 1 1 shows that the Martin space of A is homeomorphic to the Cartesian 
product of two copies of the Martin space of Example I1U.3I in other words, that 
there is an homeomorphism from ^ to Z x Z. Proposition 19.11 also shows that 
the same homeomorphism sends J?r to Z x Z and the minimal Martin space to 
({±cx)} x Z) U (Z X {±00}). Thus, the Martin boundary and the minimal Martin 
space are the same. This example may be considered to be the max-plus analogue 
of the random walk on the 2-dimensional integer lattice. The Martin boundary for 
the latter (with respect to eigenvalues strictly greater than the spectral radius) is 
known )NS66j to be the circle. 

Example 10.5. Let S = Q and Aij = —\i — j\. Choosing to be the basepoint, 
we get Kij ^ —\i — j\ + \j\ for all j G Q. The Martin boundary ^ consists of the 
functions i —\i — j\ + \j\ with j S R \ Q, together with the functions z 1— > z and 
i 1—^ —i. The Martin space ^ is homeomorphic to M := R U {±00} equipped with 
its usual topology. 
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Example 10.6. We give an example of a complete locally compact metric space 
(5, d) such that the canonical injection from S to the Martin space ^ is not an 
embedding, and such that the Martin boundary — ./#\^ is not closed. Consider 
S — {(hj) I i > J ^ 1} and the operator A given by 



^(ij),('J + l) 



= A, 



-2, for i - 1 > j > 1, 

^(1,1), = ^(i,i),(o,o) = for * > 2, 

with all other entries equal to —oo. We choose the basepoint (1, 1). The graph of 
A is depicted in the following diagram: 




We are using the same conventions as before. The arcs with weight —2 are drawn 
in bold. One can check that 

AhuKi) - max ( - I* - k\ - 2\j - £|, -(z - j) - {k ~ £) - - 0(£)) 

where = l/j if j > 2, and = if j = 1. In other words, an optimal 
path from {i, j) to (fc, £) is either an optimal path for the metric of the weighted £i 
norm f-^ \i\ + 2\j\, or a path consisting of an horizontal move to the diagonal 
point (j, j), followed by moves from (j, j) to (1, 1), from (1, 1) to {£,£), and by an 
horizontal move from {£,£) to {k,£). Since A is symmetric and A* is zero only on 
the diagonal, d{{i,j), (fc, £)) := —A*^^ is a metric on 5". The metric space (S", d) 

is complete since any Cauchy sequence is either ultimately constant or converges 
to the point (1,1). It is also locally compact since any point distinct from (1,1) is 
isolated, whereas the point (1, 1) has the basis of neighbourhoods consisting of the 
compact sets Vj = {(i, i) \ i > j} U {(1, 1)}, for j > 2. 

If {{im-i jm))m>i IS any sequence of elements of 5* such that both im and j,n tend 
to infinity, then, for any {k,£) G 5*, 

^{k.i},{^„,,3,„) =^ ^(fc,£), (1, 1)^(1, ^ ^'^^g^ enough. 
(Intuitively, this is related to the fact that, for m large enough, every optimal path 
from {k,£) to {im,jm) passes through the point (1,1)). It follows that K. ^i^ j^-^ 
converges to if. (i i) as m oo. However, the sequence {im,jm) does not converge 
to the point (1,1) in the metric topology unless im = jm for m large enough. This 
shows that the map («, j) — > K. ^i j^ is not an homeomorphism from S to its image. 

The Martin boundary consists of the points obtained as limits of 

horizontal half-lines, which arc almost-geodesics. We have 

lax (i~£~ 2\j ^£\+ (/)(£), -(z - j) - 0(j)) . 



The functions are all distinct because i i— > ^^"^ --^ has a unique maximum attained 
at i = £. The functions do not belong to ^ because ^^3^ ^-^ = j + ^ + 4>{i) j 
as j tends to infinity, whereas for any w £ J(f, W[3jj) — —2j — ~ — 2j as j 
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tends to infinity,. The sequence converges to (i i) as I tends to infinity, which 
shows that the Martin boundary !3§ = ^ \ ,J€ is not closed. 

Example 10.7. We next give an example of a Martin space having a boundary 
point which is not an extremal generator. The same example has been found 
independently by Webster and Winchester |WW03bj . Consider 5* := N x {0, 1, 2} 
and the operator A given by 

for alH G N and j £ {0, 2}, with all other entries equal to — oo. We choose (0, 1) 
as basepoint, so that tt := A*q ^-^ is such that T^(ij) = —(i + 1) if j = or 2, and 
TTjj j) = — (i + 2) if j = 1 and i 0. The graph associated to the matrix A is 
depicted in the following diagram, with the same conventions as in the previous 
example. 



There are three boundary points. They may be obtained by taking the limits 
^° lim K..{ifi), 1™ and := lim K.(i,2)- 

I — *00 ■ 2— i-OO I — ^OO 

Calculating, wc find that 

=^-:} + l, =i + :]-l, and = e° ® • 

We have H{f,i°) = = = = 0. For all other pairs 

^) G X we have if (^', = ^2. Therefore, the minimal Martin boimdary is 
^™ = ^^}, and there is a non-extremal boundary point, , represented above 
by a gray circle. The sequences ((i, 0))igN and ((i, 2))igN are almost-gcodesics, while 
it should be clear from the diagram that there are no almost-geodesics converging 
to . So this example provides an illustration of Propositions 17.31 and 17.81 

Example 10.8. Finally, we will give an example of a non-compact minimal Martin 
space. Consider S' := N x N x {0, 1} and the operator A given by 

^(«j,fc),(»,i+i,fc) = Ai^t,j+i.k)..(i.]M) = fo'' all J e N and k e {0, 1}, 

Al^,J,k),i^,j,l-k) = -1, for aU i e N, j e N \ {0} and k e {0, 1}, 

^(i,o,fc),(^o,i-fc) = for aU i e N and k e {0, 1}, 

^(»,o,fc),(j+i,o,fc) = ^(i+i,o,fc),(i,o,fc) = -1, for aU i e N and k G {0, 1}, 



with all other entries equal to —oo. We take tt := A*^ o o) •■ With the same conven- 
tions as in Examples 1 1 . 41 and 1 1 . 71 the graph of A is 
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Recall that arcs of weight —1 are drawn with thin lines whereas those of weight —2 
are drawn in bold. 

For all fc),(z',/,fc') e 5, 

\^' - *l - \ f - j\Xi=i' - (j + j')Xi^i' - X3=j'=o,k^k' , 
where xe takes the value 1 when condition E holds, and otherwise. Hence, 



,{^',3',k') - \k' - k\+i' - \i' - - \J'-j\x^=^' - {.] + J')x^^^ 



+ X]'=0,k' 



X]=j'=o,k^k' 



By computing the limits of K. j^ii y ki-^ when i' and/or j' go to +oo, we readily check 
that the Martin boundary is composed of the vectors 



^2 ,oo,k 
^00,0, /e' 



:= hm K. 



{i',j',k')i 



lim K. 



I' J' — >oo 

lim K. 



(j',0,fc')- 



where the limit in i and j' in the second line can be taken in either order. Note 
that linv^oo ^ ^^.oo,k' foj. ^ny j' £ N \ {0} and k' e {0,1}. The 

minimal Martin space is composed of the vectors and with z' G N 

and k' e {0, 1}. The two boundary points and are non-extremal and 

have representations 

^00,00,0 ^00,0,0 ^^'^'O'l 

^oo,oo,l ^00,0,0 -|^^oo,0,l 

For k' G {0, 1}, the sequence '""''^ converges to as i goes to infinity. 

Since this point is not in we see that ^™ is not compact. 



11. Tightness and existence of harmonic vectors 

We now show how the Martin boundary can be used to obtain existence results 
for eigenvectors. As in |AGW04| . we restrict our attention to the case where S is 
equipped with the discrete topology. We say that a vector u G K^ax A-tight if, 
for all i G 5 and /3 G M, the super- level set {j £ S \ AijUj > /?} is finite. We 
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say that a family of vectors {u^}eeL C Rnmx ^-tight if sup^g^ is ^-tight. The 
notion of tightness is motivated by the following property. 

Lemma 11.1. // a net {u^j^gi C Kmax A-tight and converges pointwise to u, 
then Au^ converges pointwise to Au. 

Proof. This may be checked elementarily, or obtained as a special case of general 
results for idempotent measures (Aki95„|AQV98, Aki99 PuhOl, or, even more gen- 
erally, capacities |UV9H . We may regard u and v} as the densities of the idempotent 
measures defined by 

Qu{J) = supwj and Qu'iJ) = sup it' , 
jeJ jeJ 

for any J C S. When S is equipped with the discrete topology, pointwise con- 
vergence of {u^)i^L is equivalent to convergence in the hypograph sense of convex 
analysis. It is shown in |AQV98| that this is then equivalent to convergence of 
iQu^)i<£L in a sense analogous to the vague convergence of probability theory. It 
is also shown that, when combined with the tightness of {ui)i^l^ this implies con- 
vergence in a sense analogous to weak convergence. The result follows as a special 
case. □ 

Proposition 11.2. Assume that S is infinite and that the vector Tr~^ := (7r~^)igs 
is A-tight. Then, some element of is harmonic and, if ^ ^ ^ , then is 
non-empty. Furthermore, each element of S§ is harmonic. 

Proof. Since S is infinite, there exists an injective map n G N i-^ i„ G S*. Consider 
the sequence (in)n&i. Since ^ is compact, it has a subnet {jk)keD, jk '■= in^ such 
that {K.jf^}k^K converges to some w G Let i G S. Since {AA*)ij = Aj^ = A*j 
for all j ^ i, we have 

when jk ^ i. But. by construction, the net {jk)k^D is eventually in 5'\{i} and so 
we may pass to the limit, obtaining Ivaik^K AK.j^ = w. Since tt^^ is A-tight, it 
follows from Q that the family {K.j)j^s is A-tight. Therefore, by Lemma 111. II 
we get w = Aw. If (D ^ then contains a non-zero vector, and applying the 
representation formula H24(l to this vector, we see that cannot be empty. 

It remains to show that 3S C J^. Any w G ^ is the limit of a net {K.ji.}keD- 
Let i E S. Since w ^ K.i, the net {K.j^}k£D is eventually in some neighbourhood 
of w not containing K.i. We deduce as before that w is harmonic. □ 

Corollary 11.3 (Existence of harmonic vectors). Assume that S is infinite, that 
TT = Al, G M.^ for some b G S, and that it~^ is A-tight. Then, contains a 
non-zero vector. 

Proof. We have Ki,j = 1 for all j E S and hence, by continuity, Wb = t for 
all w G In particular, ./# docs not contain (D. The result follows from an 

application of the proposition. □ 

We finally derive a characterisation of the spectrum of A. We say that A is a 
(right) -eigenvalue of A if Au = Xu for some vector u such that u 7^ (D. 

Corollary 11.4. Assume that S is infinite, A is irreducible, and for each i G S, 
there are only finitely many j G S with Ajj > (D. Then the set of right eigenvalues 
of A is [p(A),oo[. 
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Proof. Since A is irreducible, no eigenvector of A can have a component equal to 
(D. It follows from |Dud92l Prop. 3.5] that every eigenvalue of A must be greater 
than or equal to p{A). 

Conversely, for all A > p{A), we have p{X~^A) < 1. Combined with the irre- 
ducibihty of A, this imphes |AGW04I Proposition 2.3] that all the entries of (A"^A)* 
are finite. In particular, for any b € S, the vector tt {X^-^A)l, is in . The 
last of our three assumptions ensures that tt~^ is (A^^y4)-tight and so, by Corol- 
larv lll.51 (X^^A) has a non-zero harmonic vector. This vector will necessarily be 
an eigenvector of A with eigenvalue A. □ 

Example 11.5. The following example shows that when '!t~^ is not A-tight, a Martin 
boundary point need not be an eigenvector. Consider 5 := N and the operator A 
given by 

Ai.i+i ~ Ai+i^i := —1 and Aoi := for all i G N, 

with all other entries of equal to — cx). We take tt := Aq .. With the same conventions 
as in Example 111). 71 the graph of A is 

• « „ -9^ -9^ »- O 




We have A* j = max(— — |i — j\) and tt; = for all i, j e N. There is only one 
boundary point, b := limfc^oo^'/c; which is given by bi = — t for all i € N. One 
readily checks that 6 is not an harmonic vector and, in fact, A has no non-zero 
harmonic vectors. 

12. Eigenvectors of Lax-Oleinik semigroups and Busemann points of 

NORMED spaces 

We now use the Martin boundary to solve a class of continuous-time deterministic 
optimal control problems. Consider the value function v defined by: 

v{t,x):= sup (f>{X{t))-[ L{X{s))ds . 

Xi),X{0)=x Jo 

Here, x is a point in M", t is a nonnegative real number, the Lagrangian L is a Borel 
measurable map R" ^ R U {+oo}, bounded from below, the terminal reward is 
an arbitrary map M" — » M U {— oo}, and the supremum is taken over all absolutely 
continuous functions X : [0,t] R" such that X{0) = x. This is a special case of 
the classical Lagrange problem of calculus of variations. 

The Lax-Oleinik semigroup {T*)t>o is composed of the maps T* sending the value 
function at time 0, v{0, ■) = (jj to the value function at time t, v{t, •). The semigroup 
property r*+* ^ o T"^ follows from the dynamic programming principle. The 
kernel of the operator T* is given by 

{x,y)^Tly= sup - / L{X{s))As , 

X{-), X{0)=x, X{t)=y Jo 

where the supremum is taken over all absolutely continuous functions X : [0, t] — > 
R" such that X{0) = x and X{t) = y. 
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The classical Hopf-Lax formula states that 

r^^,y = ~tcoi(^), fori>0, 

where co L denotes the convex lower semicontinuous hull of L. This is proved, for 
instance, in |Eva98[ §3.3, Th. 4] when L is convex and finite valued, and when the 
curves X{-) are required to be continuously differentiable. The extension to the 
present setting is not difficult. 

Since only depends on coL, we shall assume that L is convex, lower semicon- 
tinuous, and bounded from below. Moreover, we shall always assume that L{Q) is 
finite. 

We say that a function u : M" MU{— cxd}, not identically — oo, is an eigenvector 
of the semigroup {T*)t>o with eigenvalue A if 

T*u^u + Xt, for alH > . 

We shall say that u is extremal if it is an extremal generator of the eigenspace of 
the semigroup {T*)t>o with eigenvalue A, meaning that u cannot be written as the 
supremum of two eigenvectors with the same eigenvalue that are both different from 
it. 

One easily checks, using the convexity of L, that for all t > 0, the maximal 
circuit mean of the operator T* is given by 

p{T') = -tL{Q) . 

By Proposition 3.5 of |Dud92j or Lemma 2.2 of |AGWn4j . any eigenvalue fj, of T* 
must satisfy fi > p{T*), and so any eigenvalue A of the semigroup (T*)t>o satisfies 

A > -L{0) . 

We denote by the one sided directional derivative of L at the origin in the 
direction x: 

C(x) = lim t-^(L(tx) -L(0)) = Mt-\L(tx) - i(0)) G MUiicx)} , (30) 
t->o+ t>o 

which always exists since L is convex. 

Proposition 12.1. Assume that ^ does not take the value — oo. Then, the eigen- 
vectors of the Lax-Oleinik semigroup (T*)t>o with eigenvalue —L{0) are precisely 
the functions u : M" — > R U {— oo}, not identically — oo, such that 

-C{y ~x)+ u{y) < u{x) , for all x,y <E M" . (31) 

Moreover, when ^ only takes finite values, the extremal eigenvectors with eigenvalue 
—L{0) are of the form c + w, where c G R and w belongs to the minimal Martin 
space of the kernel (x, y) i— > — C(?/ ~ x) with respect to any basepoint. 

Proof. Let us introduce the kernels 

A, := T" + sL(0), for all s > 0. 

Using the Hopf-Lax formula, we get 

(A,)+= sup -fcsLf^— ^) +fcsL(0) . 

fc6N\{0} \ ks / 

Using H3U|) and the fact that C(0) = 0, we deduce that 

{A,)ly ^ iA,)ty ^ -Ciy ^ x) . (32) 



THE MAX-PLUS MARTIN BOUNDARY 



31 



The eigenvectors of the semigroup (T*)t>o are precisely the functions that are har- 
monic with respect to all the kernels As, with s > 0. Since {As)xx = for all 
X G M", the harmonic and super-harmonic functions of As coincide. It follows from 
Proposition 12. II that u is a super-harmonic function of As if and only if u > A^u. 
Since the latter condition can be written as (|31|l and is independent of s, the first 
assertion of the corollary is proved. 

By H32(l . when C, is finite, any point can be taken as the bascpoint. The kernels 
As and {x, y) ^ —Q{y — x) have the same Martin and minimal Martin spaces with 
respect to any given basepoint, and so the final assertion of the corollary follows 
from Theorem 16. 21 □ 

Remark 12.2. When dL{Q), the subdifferential of L at the origin, is non-empty, C, 
does not take the value — oo. This is the case when the origin is in the relative 
interior of the domain of L. Then, Q coincides with the support function of dLifi): 

C,{x) = sup y ■ X, for all a; £ R" , 
ye9L(o) 

see |R.oc7ni Th. 23.4]. If in addition the origin is in the interior of the domain of L, 
then 9L(0) is non-empty and compact, and so the function C is everywhere finite. 

Corollary 12.3. When is a norm on R", the extremal eigenvectors with eigen- 
value — i(0) of the Lax-Oleinik semigroup (T*)t>o are precisely the functions x i— > 
c C(2/ ~ where c G M and y G K", together with the functions c + w, where 
c G M and w is a Busemann point of the normed space (R", 

Proof. This follows from Proposition 112.11 and Corollarv l7.13l □ 

Remark 12 A. The map C is a norm when the origin is in the interior of the domain 
of L and the subdifferential dL{0) is symmetric, meaning that p G dL{0) implies 
—p G dL{0). When C is a norm, condition H31|l means that u is Lipschitz-continuous 
with respect to C or that u is identically — oo. 

We next study the eigenspace of [T^)t>a for an eigenvalue A > — i(0) in the 
special case where L is of the form 

P 

where || • || is an arbitrary norm on R" and p> \. For all A > 0, we set 

d\ := (<zA)9 where - + - = 1 . 

p q 

Theorem 12.5. Let s > and A > 0. Any eigenvector of T'^ with eigenvalue As 
is an eigenvector of the Lax-Oleinik semigroup (T*)t>o with eigenvalue A. Such an 
eigenvector can be written as 

u = sup v{w) -\- d\w , (33) 

where denotes the set of Busemann points of the normed space (R", || • ||) and 

V is an arbitrary map RU{— oo} bounded from above. The maximal map v 

satisfying is given by Moreover, the extremal eigenvectors with eigenvalue 
A are of the form c + i^\W, where c G R and w G ^bu- 

This theorem follows from Theorem 18. II Theorem 18.31 and the next lemma. 
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Lemma 12.6. For all s > 0, the minimal Martin space of the kernel As := T'* — sA, 
with respect to any basepoint, coincides with the set of functions i^xw, where w is a 
Busemann point of the normed space (M", || ■ ||) equipped with the same basepoint. 

Proof. For all x,y ^ M", wc set 

^(t) -t^~PL{y ^x)-t\ . 

It follows from the Hopf-Lax formula that 

{As)ty - sup ij{ks) . (34) 

keN\{0} 

Since ip is concave, the supremum of ipit) over all t > is attained at the point t 
such that 

i^'{t) = t-P{p-l)L{y-x)-\ = . 

It follows that 

^{t) ^ ~dx\\y - x\\ . 
Since ip is concave, we have ip{t) > ip{t) + ip'{t){t — t), and so, for t >t, 

since ip' is convex. Let k denote the smallest integer such that t < ks, and let 
t ^ ks. Wc deduce that 

> ip{t) - ip{i) > -p{p - l)L{y - x)i-^-P{t - tf = -pXt-^it - tf . 
Since t <t <t + s, since t ~ {q^)^^^^\\y ~ x\\, and since 

m > i^sTxy > (As)+ >m , 

we get 

{As)*^ = -d,\\y-x\\+e{\\y~x\\) , (35) 

where e is a function tending to at infinity. Observe that the supremum in (|34() is 
always attained by an integer k which can be bounded by an increasing function of 
II?/ — a; II . Hence, for all x G K" and every compact set C, we can find an integer N 
such that {As)^y = sup]^<j,<^ ip(ks) for all y ^ C. Since every ij}{ks) is a continuous 
function of y — x, we deduce that the map y ^ {As)'^y is continuous. 

Denote by K the Martin kernel of Ag with respect to this basepoint and denote 
by ^ , and J>^, the corresponding Martin space, minimal Martin space, and 

set of columns of the Martin kernel. Also, we denote by H the kernel constructed 
from K as in Section 01 Define the kernel A' : {x,y) —i^\\\y — x\\. We use 
K' , , J^' and H' to denote the corresponding objects constructed from 

A'. 

Wc next show that = \ JT'. 

An element w of is the limit of a net {K.y^)d£D- If the net {yd)d£D had 
a bounded subnet, it would have a subnet converging to some y G M.'^. Then, by 
continuity of the map z i— > (^s)+, the element w would be proportional in the 
max-plus sense either to / := (^s)*y or to g := (As)^ (the first case arises if 
the subnet is ultimately constant). Both cases can be ruled out: we know from 
Proposition 14.41 that an element of the minimal Martin space is harmonic, but 
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.fy = 0^ gy = {Asf)y = — sA ^ {Asg)y ~ — 2sA, and so / and g are not harmonic. 
This shows that {yd)deD tends to infinity. 

By (|35|l . we deduce that K'y^ tends to w. Thus, any net {yd)d£D such that K.y^ 
tends to w is sucli tliat yd tends to infinity and K'y^ tends to w. We deduce that 
w£^' and H'{w, w) > H{w, w) = 1, and so, by C U Jf' . 

We proved that the columns of (As)* are not harmonic, and so C ^ \ J^. 
We claim that ./#™ C \ JT'. Indeed, if a net K.y^ converges to w G 

we showed that {yd)de d tends to infinity, and that K'y^ tends to w. But K'y^ 
cannot converge to an element K'.y S because the map sending an element of a 
finite-dimensional normed space to its column of the Martin kernel is an embedding 
(see |Bal95l Ch. II,§1] for a more general result). So w ^ J(f' . 

Let us take now w' £ ./^"" \ J^' . Then, w' is the limit of some net )d&D', 
where {y'ij)deD' necessarily tends to infinity, since otherwise, there would be a subnet 
of {y'j)d£D' converging to some z € K", and so we would have w' = K'.^ g J(f'. It 
follows from H35|) that w' is the limit of K.y'^, and hence w' G . These properties 
also imply that H'{w',w') < H{w',w'). Since w' € we have H'{w',w') = 1, 

and so H{w' , w') = 1, and by (fT^ . w' £ U Jf. Observe that the map z t-^ w'^ 
is continuous because it is a pointwise limit of elements of J^', all of which are 
Lipschitz continuous with constant -dx with respect to the norm [| • ||. For all y g K", 
the map x i-^ A'^y takes the value when x = y and the value {As)^y < —sX < 
when X ^ y. Thus, the elements of J€ are not continuous, and so, w' ^ J(f . It 
follows that w' G Ji^^ \X = J^-"\ We have shown that = \ JT'. 

By Corollarv l7.13l \ Jff' is the set of Buscmann points of the normed space 
(M",'i?A|| • ID- These are precisely the functions of the form 'd\w^ where w is a 
Busemann point of (M", || • |j). □ 

Remark 12.7. Lemma Fl 2 . 61 identifies a special situation where the minimal Martin 
space of T'* — sA is independent of s. This seems related to the fact that the set 
of functions of the form x i— > a||a;p with a > is stable by inf- convolution. One 
may still obtain a representation of the eigenvectors for more general semigroups 
(2^*)t>0; but this requires adapting some of the present results to the continuous- 
time setting. We shall present this elsewhere. 

Example 12.8. Consider the Euclidean norm on R", ||a;|| := (x ■ x)^/^, and L{x) := 
with p > 1. The set of Busemann points of the normed space (K", || • ||), 
with respect to the bascpoint 0, coincides with the set of functions 

w : X ^ X ■ y , 

where y is an arbitrary vector of norm 1 . It follows from Theorem 112.51 that the 
extremal eigenvectors with eigenvalue A > of the Lax-Oleinik semigroup are of the 
form c+'d\w, with c G R, and that any eigenvector with eigenvalue A is a supremum 
of maps of this form. In particular, when n = 1, there arc two Busemann points, 
w'^{x) = ■ii'&xx, and any eigenvector u with eigenvalue A can be written as 

X I— > max(c^ + dxx, c~ — 'dxx) , 

with G R U {— oo}. The Buscmann points are the limits of the geodesies 
t i-^ ±t, from [0, oo[ to R. Hence, Proposition 17.61 allows us to determine the 
maximal representing measure /Lt„, or equivalently, the maximal value of the scalars 
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c^, as follows: 

= lim u{t) =F -dxt . 

t — >±oo 

In this special case, the representing measure is unique. 

In order to give another example, we characterise the Busemann points of a 
polyhedral norm. We call proper face of a polytope the intersection of this polytope 
with a supporting half-space. 

Proposition 12.9. Let \\ ■ \\ denote a polyhedral norm on M", so that 

\\x\\ ~ maxx^ • X , 

where {x[)i^i is the finite family of the extreme points of the dual unit ball. The 
Martin boundary of the kernel {x,y) —\\x — y\\, taking the origin as the basepoint, 
is precisely the set of functions of the form 

X !■ minx' ■ [x — X) + max a:;' • X , (36) 

where X g E" and {x'j)j^j is the set of extreme points of a proper face of the dual 
unit ball. Moreover, all the points of the Martin boundary are Busemann points. 

Proof. Any point / of the Martin boundary is the limit of a sequence of functions 

x^f^{x)^\\X'^\\-\\X'^-x\\ , 

where X'' G M" and \\X''\\ oo when k ~* oo. Consider the sequence of vectors 

u" = ix', ■ x" - wx^wy.^j . 

These vectors lie in [~oo,0Y , which is compact and metrisable, and so, we may 
assume, by taking a subsequence if necessary, that m'^ converges to some vector 
u G [— cxD,0]^. Since / is finite, we may also assume, again taking a subsequence if 
necessary, that there exists an index jo G / such that x'j^ ■ X^ = for all k. 

Let J := {i E I \ Ui > — oo}. Observe that J is non-empty since Uj^ = 0. We have 

fix) = lim f''{x) = lim - max(a;- • X'' - WX'']] - x- ■ x) 

k — 'OO k — 'OO iGl 

= — maxfu,- — a;' • x) . 

Observe that the set E := {{{x'j — x^^) • X)j^j \ X e M"} is closed, since it is a 
finite-dimensional vector space. Since the vector {u^)j,=j belongs to E and has a 
finite limit when k oo, this limit belongs to E, and so there exists some X G R" 
such that Uo = a;' ■ X — x': ■ X for all j G J. Thus, 

f(x) = — maxa:^- ■ {X — x) ^ x'^^ ■ X . 

Since /(O) = 0, we have max^gj x'^ ■ X = x'j^ ■ X, and so 

fix) = — max a:', ■ iX — a;) + max a;' • X , 

which is of the form (|36() . 

We now have to show that {Xj)j^j is the set of extreme points of a face of the 
dual unit ball. Let E' denote the set of vectors x' G K" such that x' ■ X^ - \\X'^\\ 
remains bounded when k tends to infinity. This is an affine space. Let B' denote 
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the dual unit ball. We claim that F' := E' DB' is an extreme subset of B', meaning 
that 

ax' + (1 - a)y' e F' =^ x' , y' G F' , for all x' , y' e B' and < a < 1. (37) 

Indeed, let x' , y' E B' and < a < 1. Since x' E B' , wc have x' ■ X < \\X\\ for aU 
X G R". In particular, x' ■ X'' - \\X''\\ < for all k. Similarly, y' ■ X'' ~ \\X''\\ < 
for all k. Since 

{ax' + (1 - a)y') ■ X^ - \\X^\\ = a{x' ■ X^ - \\X^\\) + (1 - a){y' ■ X^ - \\X% 

< a{x' ■X'' - WX'^W) 
<0 , 

we deduce that x' ■ X^ - 11-'^'^ II is bounded if ax' + (1 - a)y' E F' . Similarly, 
y' -X^ - \\X^\\ is bounded. This shows (|S7jl . 

Let z denote any accumulation point of the sequence j|X'^||^^X''. We have 
F' C{x' EB' \ x' ■ 1}, and so, F' ^ B' . 

Since the dual ball B' is a polytope, the convex extreme subset F' ^ B' \s a. 
proper face of B' . Therefore, the vectors x'^, with i E I, such that x'^ ■ X^ — \\X''\\ 
remains bounded are precisely the x'^ that belong to the proper face F' . Hence, 
these x'^ are the extreme points of the proper face F'. 

Every proper face F' of the dual ball is the intersection of the dual ball with a 
supporting hyperplane, so F' = {x' E B' \ x' ■ y = 1} for some y E B. Observe 
that the set J of x'^ such that x'^ - y = 1 is precisely the set of extreme points of F'. 
Consider now X E M" and the ray 1 1-^ X + ty, which is a geodesic, and a fortiori an 
almost-geodesic. One readily checks that the function x i-^ ||X + i2/|| — HX + ty — a;|| 
converges to the function when t tends to +cx3, and so, every point of the 
Martin boundary is a Buscmann point. □ 

Remark 12.10. Karlsson, Metz, and Noskov |KMN04| have shown previously that 
every boundary point of a polyhedral normed space is the limit of a geodesic, and 
hence a Busemann point. They did this by characterising the sequences which 
converge to a boundary point. 

Example 12.11. Consider now L{x) := ||.t|[Po/p with H-xHoo max(|a;i|, • ■ • , |cc„|) 
and p > 1. By ProDOsition ll2.9l the Buscmann points of (R", || • ||oo) with respect 
to the basepoint are of the form: 

w : X i-^ minei(a;i ^ XA + maxe^Xi , 
lei lei 

where / is a non-empty subset of {1, . . . , n}, = ±1, and the Xi are arbitrary reals. 
Theorem II 2 . 51 shows that any eigenvector with eigenvalue A > of the Lax-Oleinik 
semigroup can be written as a supremum of maps c + 'dxw, where c G M U {— oo} 
and w is of the above form. For instance, when n = 2, the functions w arc of one 
of the following forms: 

ei.Ti, €2X2, or min(ei(a;i - Xi), e2(a;2 - X2)) + max(eiXi, e2-'i^2) , 
with Xi,X2 E K and ei = ±1,62 = ±1- 

Remark 12.12. It is natural to ask whether the eigenvectors of the Lax-Oleinik 
semigroup (T^)t>a coincide with the viscosity solutions of the ergodic Hamilton- 
Jacobi equation 

L*{Vu) = A , 
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where L* denotes the Legendre-Fenchel transform of L. This is proved in |Fat03al 
Chapter 7] in the different setting where the space is a compact manifold and the 
Lagrangian L can depend on both the position and the speed but must satisfy 
certain regularity and coercivity conditions. 
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